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Abstract 



We call a conic linear system P badly behaved, if for some objective function 
c the value sup {{c,x)\x G P} is finite, but the dual program has no solution 
attaining the same value. We give simple, and exact characterizations of badly 
behaved conic linear systems. Surprisingly, it turns out that the badly behaved 
semidefinite system 



where a is again some real number, and if is a second order cone. 

Our characterizations provide JvVDco-MV certificates in the real number model 
of computing to recognize whether semidefinite, and second order conic systems are 
badly behaved. 

Our main tool is one of our recent results that characterizes when the linear 
image of a closed convex cone is closed. 
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1 Introduction. A sample of the main results 

Conic linear programs, as introduced by Duffin (|17]) in the fifties provide a natural 
generalization of linear programming. Until the late eighties the main aspect of conic 
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where a is some real number, appears as a minor in all such systems in a well- 
defined sense. We prove analogous results for second order conic systems: here the 
minor to which all bad systems reduce is 
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LPs that optimizers and convex analysts focused on was their duahty theory. It is 
largely inherited from linear programming; however, when the underlying cone is not 
polyhedral, pathological phenomena occur, such as nonattainment of the optimal value, 
positive duality gaps, and infeasibility of the dual, when the primal program is bounded. 

Nesterov and Nemirovskii |26) in the late eighties developed a general theory of 
interior point methods for conic LPs: the two most prominent efficiently solvable classes 
are semidefinite programs (SDPs), and second order conic programs (SOCPs). Today 
SDPs and SOCPs are covered in several surveys and textbooks, and are a subject of 
intensive research ([SI El [361 111 EH ttH [IS])- The website [21j is a good resource to keep 
track of new developments. 

This research was motivated by the curious similarity of pathological SDP instances 
appearing in the literature. We will present characterizations on when a conic linear 
system is well- or badly behaved from the standpoint of duality. Specialized to semidef- 
inite programming, we obtain the main, surprising finding of the paper, namely that 
all badly behaved SDPs "look the same, " and the trivial badly behaved semidefinite 
system (jO.ip appears as a minor in all such systems. We prove similar results for SOCPs. 

We first present our general framework below. 

Definition 1. Let X and Y be finite dimensional euclidean spaces, c X, b £ Y, and 
A : X ^ Y a linear map. Let C y be a closed, convex cone, and write s <k t to 
denote t — s G K. The conic linear programming problem parametrized by the objective 
function c is 

sup (c, x) ^ 
s.t. Ax <K b. 

The primal conic sytem is defined as 

P = {x\Ax<Kb}. 

To define the dual program, we let A* be the adjoint operator of A, and K* the dual 
cone of K, i.e., 

K* = {y\{y,x)> OVx eK}. 

The dual problem is then 

inf (6, y) 

s.t. y >K' (Dc) 
A*y = c. 

Definition 2. We say that the system P is well-behaved, if for all c objective functions 
for which the value of {Pc) is finite, the dual has a feasible solution which attains the 
same value. We say that P is badly behaved, if it is not well-behaved. A more formal 
terminology, coined by Duffin, Jeroslow, and Karlovitz [16] for semi-infinite systems 
is saying that P yields, or does not yield uniform LP- duality; we use our naming for 
simplicity. 
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The most important class of conic LPs we study in this paper is semidefinite pro- 
grams. We denote by 5" the set of n by n symmetric, and by 5" the set of of n by n 
symmetric positive semidefinite matrices. For 5", T G 5" let us write 5" ^ T to denote 
T — S £ 5", and define their inner product as 5 • T = "^^j^i Sijtij. The primal-dual 
pair of semidefinite programming problems is then 



Em 
i=l CiXi 

(SDP,) s.t. EZi^iAi^B 



inf B»Y 

s.t. Y 



{SDD,) 



Ci (i = 1, . . . ,m), 



where ^i, . . . , Am, and B are in 5". The pair (SDPc) — (SDDc) is indeed a pair of conic 
LPs. So as not to distract from the main development of the paper, we formally show 
how they fit in the general framework of Definition [1] in the beginning of Section [3l 

The primal semidefinite system is 

m 

PsD = {x \ Y^XiA^B}. 

1=1 

The two motivating examples of pathological SDPs follow: 
Example 1. In the problem 




the only feasible solution is xi = 0. Li the dual program let us denote the components of 
Y by Uij. The only constraint other than semidefiniteness is 2yi2 = 1, so it is equivalent 
to 

inf yii 

'yu 1/2' 

which has a infimum, but does not attain it. 
Example 2. The problem 

sup X2 



s.t. 



>=0, 
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again has an attained supremum. The reader can easily check that the value of the 
dual program is 1, (and it is attained), so there is a finite, positive duality gap. 
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Curiously, while their "pathology" differs, Examples [T] and [2] still look similar: if 
we delete the second row and second column in all matrices in Example [21 remove the 
first matrix, and rename X2 as xi, we get back Example [T) This raises the following 
questions: Do all badly behaved semidefinite systems "look the same"? Does the system 
of Example [1] appear in all of them as a "minor" ? In the following we make these 
questions more precise, and prove that the answer is yes to both. The paper contains a 
number of results for general conic LPs, but we state the ones for semidefinite systems 
first, since this can be done with minimal notation. 

Assumption 1. Theorems {1\ andl^ are stated "modulo rotations", i.e., we assume that 
we can replace Ai by T'^AiT for i = 1, . . . ,m, and B by T^BT for some invertible 
matrix T. 

We also assume that the maximum rank slack in Pgo is of the form 



0, 



:i.3) 



Theorem 1. The system Psd is badly behaved, if and only if there exists a matrix V 
which is a linear combination of the Ai and B of the form 



V 



Ml 



V ■ 



ei . . 





V? 



:i.4) 



33/ 



where Vu is r by r, e\ is the first unit vector, V33 is positive semidefinite (maybe an 
empty matrix), and the dots denote arbitrary components. □ 

The Z and V matrices provide a certificate of the bad behavior of Psd- For example, 
they are 



in Example [H and 
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in Example [21 The reader may find it interesting to spot the certificates in the other 
badly behaved systems appearing in the literature. 

Corollary 1. Consider the following four elementary operations performed on Psd '■ 



(1) Rotation: for some T invertible matrix, replace Ai, . . . , Am by T'^AiT, . . . , T^AmT, 
respectively, and B by T^BT. 
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(2) Contraction: replace a matrix Ai ^2/ X^JLi A^vlj, and replace B hy B + 'Y^^il^jA 
where the Xj and fij are scalar s, and Aj 7^ 0. 

(3) Delete row £ and column i from all matrices. 

(4) Delete a matrix Ai. 

If PsD is badly behaved, then using these operations we can arrive at the system 
where a is some real number. 



□ 



Well-behaved semidefinite systems have a similarly simple characterization: 



Theorem 2. The system Psd is well-behaved, if and only if conditions ([ip and ^ 
below hold: 



(1) there exists a matrix U of the form 

U = 

which satisfies 

Ai»U = ... = 





\0 In-r) ' 

Am»U = B»U = Q. 



(2) For all V matrices, which are a linear combination of the Ai and B and are of the 
form 

fVn VA 



V 



with Vii G S^, we must have V12 = 0. 







□ 



Example 3. The semidefinite system 
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is well-behaved, despite its similarity to the system in Example{I[ The maximum slack 
and the U matrix of Theorem are 
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and since the entries in positions (1,2) and (1,3) are zero in all constraint matrices, 
condition trivially holds. 

Corollary 2. The question 

"Is PsD well-behaved?" 
is in MV n co-MV in the real number model of computing. 

□ 

Our main results build on three pillars. First, we describe characterizations (in con- 
ditions ([2]) and ([3]) in Theorem [5|) of when the conic system P (defined in Definition 
[1]) is well-behaved. These results involve the closedness of the linear image of K* and 
K* X ]R_,_, where K* is the dual cone of K. The closedness of these linear images is not 
easy to check in general, so we invoke a recent result from [31] on the closedness of the 
linear image of a closed convex cone, which we recap in Theorem [3l This accomplishes 
the following: with z a maximum slack in the system P, and dir(2;, K) the set of feasi- 
ble directions at z in the cone K, the well behaved nature of P will be related to how 
dir(z, K) intersects the linear subspace spanned by A and h. An equivalent characteri- 
zation is given using the concept of strict complementarity, and the tangent space of K 
at z. Somewhat surprisingly. Theorem [5] unifies two seemingly unrelated conditions for 
P to be well-behaved: Slater's condition, and the polyhedrality of K. 

Since dir(2;, K) is a well structured set when K is the semidefinite or second order 
cone, a third step, which is some linear algebra, allows us to put the characterization 
for semidefinite and second order conic systems into a reasonably aesthetic shape, like 
Theorem [T] above. The closedness result from [HT] also makes it possible to prove the 
polynomial time verifiability of the good and bad behavior of semidefinite and second 
order conic systems. 

Literature review Linear programs with conic constraints were first proposed by 
Duffin in ^7J mainly as a tool to better understand the duality theory of convex pro- 
grams. For textbook and survey treatments on conic duality we refer to O [U [351 1321 
[251 [361 [HI. 

Our main results hinge on Theorem [3l which gives conditions for the linear image 
of a closed convex cone to be closed. While this question is fundamental, there is 
surprisingly little recent literature on the subject. We refer to [37] for a sufficient 
condition; to [3] for a necessary and sufficient condition on when the continuous image 
of a closed convex cone is closed, and to [3] for a characterization of when the linear 
image of a closed convex set is closed. More recently [7] studied a more general problem, 
whether the intersection of an infinite sequence of nested sets is nonempty, and gave a 
sufficient condition in terms of the sequence being retractive. The question whether a 
small perturbation of the linear operator still leads to the closedness of the linear image 
has been recently studied in [lOj . 
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The study of constraint qualifications (CQs) is also naturally related to our work. 
CQs are conditions under which a conic linear system, or a semi-infinite linear system 
(a system with finitely many variables, and infinitely many constraints), has desirable 
properties from the viewpoint of duality. Slater's condition (the existence of an x such 
that h — Ax is in the relative interior of K) is sufficient for P to be well-behaved, but not 
necessary. The same holds for the polyhedrality of K. Another approach is to connect 
the desirable properties of a constraint set to the closedness of a certain related set. 
In this vein |16] introduced the notion of uniform LP-duality for a semi-infinite linear 
system, and showed it to be equivalent to such a CQ. Our condition ([2]) in Theorem 
[5] is analogous to Theorem 3.2 in [16j. More recently, [231 [13] and ^3j studied such 
CQs, called closed cone constraint qualifications for optimization problems of the form 
inf {/(x) I X G C, g{x) E ET}, where is a closed convex cone, and C is a closed 
convex set. These CQs guarantee that the Lagrange dual of this problem has the same 
optimal value, and attains it. In particular, Condition ([2]) in our Theorem [5] specializes 
to Corollary 1 in |23] when K is the semidefinite cone, and Theorem 3.2 in |13] gives 
an equivalent condition, though stated in a different form. Closed cone CQs are weaker 
than Slater type ones, however, the closedness of the related set is usually not easy to 
check. A similar CQ for inequality systems in infinite dimensional spaces was given in 
[12| . and a minimal cone based approach, which replaces K hy a. suitable face of K to 
obtain strong duality results was introduced in [llj . 

Where our results differ from the constraint qualifications listed above is that besides 
characterizing exactly when P is well-behaved, they are polynomial time verifiable for 
semidefinite and second order conic systems, and yield easily "viewable" certificates, as 
the Z and V matrices and the excluded system (jO.ip : the key is the use of Theorem [3j 

Organization The rest of the introduction contains notation and definitions. In Sec- 
tion [2] we describe characterizations of when P is well behaved in Theorem [5j In Section 
[3| we prove Theorems [T] and [21 and Corollaries [T] and [21 In Section [H we derive similar 
results for second order conic systems, and systems over p-cones. Finally, in Section [5l 
we prove that conic systems given in a different form (dual form, like the feasible set 
of (-De) ) or in the subspace form used by Nesterov and Nemirovskii in |26j are well- 
behaved, if and only if the the system we obtain by rewriting them in the standard form 
of P is. 

Notation, and preliminaries The general references in convex analysis we used are: 
Rockafellar [33j, Hiriart-Urruty and Lemarechal [22J, and Borwein and Lewis |9J. 

The closure, interior, boundary, relative interior and relative boundary of a convex 
set C are denoted by cl C, int C, bd C, ri C, and rb C, respectively. For a convex set C, 
and X G C we define the following sets: 

dir(x,C) = { y I X + ey € Cfor somee > }, (1.5) 
ldir(x,C7) = dir(x, C7) n - dir(x, C), (1.6) 
tan(x,C7) = cl dir(x, C) n - cldir(x, C). (1.7) 
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Here dir(x, C) is the set of feasible directions at x in C, ldir(x, C) is lineality space of 
dir(x, C), and tan(x, C) is the tangent space at x in C. 

The range space, and nullspace of an operator A are denoted by TZ{A), and J\f{A), 
respectively. The linear span of set S is denoted by lin 5, and the orthogonal complement 
of lin S by S-^ . 

If X and y are elements of a euclidean space, we sometimes write x*y for {x,y), and 
if A G M, we write x/X for (1/A)x. 

A set C is called a cone, if Ax G C holds for all x € C, and A > 0. If C is a convex 
cone, its dual cone is defined as 

C* = {y |(y,x) > Vx G C}. 

Suppose that C is a closed convex cone, and is a convex subset of C. We say that 
E IS a face of C, if xi,X2 G C, and l/2(xi + X2) G implies that xi and X2 are both 
in E. For an ii^ face of C we have = C fl linii^, and we define its conjugate face as 

E^ = c*nE^. 

Similarly, the conjugate face of a G face of C* is 

= CnG^. 

Notice that the O'^ operator is ambiguous, as it denotes two maps: one from the faces 
of C to the faces of C*, and one in the other direction. 

If C is a closed convex cone, and x G C, we say that n G C* is strictly complementary 
to X, if X G ri£J for some E face of C, (i.e., E is the smallest face of C that contains x, 
cf. Theorem 18.2 in [33]), and u G rii^^. Notice that u may be strictly complementary 
to X, but not the other way. The reason is that (E^)'^ is the smallest exposed face 
of C that contains E, i.e., the smallest face of G that arises as the intersection of 
C with a supporting hyperplane, and it only equals E, when E itself is exposed. In 
the semidefinite and second order cones all faces are exposed, so in these cones strict 
complementarity is a symmetric concept. 

We say that a closed convex cone G is nice, if 

C* + E'^ is closed for all E faces of G. 

While this condition appears technical, it suffices to note that most cones appearing in 
the optimization literature, such as polyhedral, semidefinite, and second order cones are 
nice. For details, we refer to [31j. 

We state the following lemma for convenience: 
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Lemma 1. Let C he a closed convex cone, x € C, and E the smallest face of C that 
contains x. Then the following hold: 



dir(x,C) = C + linS, (1.8) 

ldir(x,C) = lin^, (1.9) 

cldir(x,C) = {E^y, (1.10) 

tan(x,C) = {E^)^. (1.11) 



Proof Statements (jl.Sp and (jl.lOp are in Lemma 3.2.1 (Lemma 2.7 in the online 
version) in |29|. Statement (jl.lip was also proved there, under the assumption that C 
is nice. In fact, it easily follows from (jl.lOp and ()1.7p in general. We now prove (|1.9p . 
Let y G ldir(x,C), then y and —y are both in dir(x,C). Using (jl.Sp . we have 

y = ci + ei = -(c2 + 62) 

for some ci,C2 € C, ei, 62 € lin£'. (Here Cj does not stand for a unit vector, rather for 
an element oi E.) Hence 

ci + C2 = -(ei + 62). 

So (1/2) (ci + C2) G C n Iin£' = E, and since is a face, ci and C2 are both in E, 
which completes the proof. □ 

The following question is fundamental in convex analysis: under what conditions is 
the linear image of a closed convex cone closed? We state a slightly modified version 
of Theorem 1 from [31], which gives easily checkable conditions for the closedness of 
M*C*, which are "almost" necessary and sufficient. 

Theorem 3. Let M be a linear map, C a closed convex cone, and x G ri(C mZ{M)). 
Then conditions H]) and ^ below are equivalent to each other, and necessary for the 
closedness of M*C*. 

(1 ) 1Z{M) n (cl dir(x, C) \ dir(x, C)) = 0. 

(2) There is u & M{M*) n C* strictly complementary to x, and 

n{M) n (tan(x, C) \ ldir(x, C)) = 0. 

Furthermore, let E be the smallest face of C that contains x. If C* + E-^ is closed, then 
conditions ([I]) and ^ are each sufficient for the closedness of M*C*. 

□ 

We make three remarks to explain Theorem [3] better: 

Remark 1. For a set C let us write fr(C) for the frontier of C, i.e., the difference 
between the closure of C and C itself. Condition ([T]) in Theorem [3] relates the two 
questions: 

Is fr(M*C*) = 0? 
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and 

Is 7e(M) nfr(dir(x,C)) = 0? 

The usefulness of Theorem [3] comes from the fact that fr(dir(3;, C)) is a well-described 
set, when C is, and this well-described set helps us to understand the "messy" set M*C* 
better. 

Remark 2. Theorem[3]is quite general: it directly implies the sufficiency of two classical 
conditions for the closedness of M*C*, and gives necessary and sufficient conditions for 
nice cones: 

Corollary 3. Let M and C he as in Theorem O Then the following hold: 

(1) If C is polyhedral, then M*C* is closed. 

(2) Ifn{M)r\TiC ^ 0, then M*C* is closed. 

(3) If C is nice, then conditions ^ and (0j in Theorem\^ are each necessary and 
sufficient for the closedness of M*C*. 



Proof Let x and E be as in Theorem [3l If C is polyhedral, then so are the sets 
C* + E-^, and dir(x,C), which are hence closed. So the sufficiency of condition ([T]) in 
Theorem [3] implies the closedness of M*C* . 

If TZ{M) n riC 7^ 0, then Theorem 6.5 in [33] implies x G riC, hence E = C. 
Therefore C* + E-^ = C*, and dir(x,C) = linC, and both of these sets are closed. 
Again, the sufficiency of condition ([T]) in Theorem [3] implies the closedness of M*C* . 

Finally, if C is nice, then C* + E-^ is closed for all E faces of C, and this shows that 
conditions ([1]) and ([2]) in Theorem [3] are each necessary and sufficient for the closedness 
ofM*C*. □ 

Remark 3. The second part of condition ([2]) in Theorem [3] is stated slightly differently 
in Theorem 1 in [31] : there it reads 

7^(M)n((^^)^\lin^) = 0. 

However, {E^)-^ = tan(x,C), and IvuE = ldir(x,C), as shown in Lemma[TJ 

In conic linear programs we frequently use the notion of solutions which are only 
"nearly" feasible. Here it suffices to define these only for (-De)- We say that {yj} C K* 
is an asymptotically feasible (AF) solution to (-De) if A*yi — > c, and the asymptotic value 
of [D,] is 

aval(I?c) = iiif{ lim inf j b*yi \ {yi} is asymptotically feasible to (Dc) }. 

Notice that if {Dc) is asymptotically feasible, then there is an AF solution {yj} C K* 
with lim6*yj = ava\{Dc). 
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Theorem 4. (Duffin flT^) Problem (Pc) is feasible with val(Pc) < +00, iff (Dc) is 
asymptotically feasible with aval(Dc) > —00, and if these equivalent statements hold, 
then 

val(Pc) = aval(I?c)- 

□ 



We denote vectors with lower case, and matrices and operators with upper case 
letters. The ith component of vector x is denoted by Xj, and the {i,j)th component of 
matrix Z by Zij. We distinguish vectors and matrices of similar type with lower indices, 
i.e., writing xi, X2, . . . and Zi, Z2, ■ ■ ■ ■ The jth component of vector Xi is denoted by Xij, 
and the (A:,^)th component of matrix Zi by Zi^ki- This notation is somewhat ambiguous, 
as Xi may denote both a vector, or the ith component of the vector x, but the context 
will make it clear which one is meant. When a matrix Y is partitioned into blocks, these 
are denoted by Yij. 

Adapting notation from [1], we use juxtaposing, or commas to denote concatenation 
of matrices along rows. That is, if Ai, . . . , Ai^ are matrices each with m rows, and 
ni, . . . , nfc columns, respectively, then (^1 ... Ak) = {Ai, . . . , Ak) has m rows, and ni + 
■ ■ ■ + Uk columns. Also, we use semicolons to denote concatenation of matrices along 
columns. That is, if Ai, . . . , Ak are matrices each with n columns, and mi, . . . ,mk 
rows, respectively, then {Ai; . . . ; A^) = {Af , . . . , A'J^)'^ is a matrix with n columns, and 
mi + • • • + rrifc rows. 

With some abuse of notation we similarly denote concatenation of elements of sets, 
and of operators. If Xi £ Xi for sets Xi (i = 1, . . . , k), then (xi; . . . ; Xk) stands for the 
corresponding element of Xi x . . . x X^.. If X, Y, A and b are as in Definition [U then the 
operator 

(::) 

maps from X x M to y x M, by assigning {Ax + 6x0; xq) to (x; xq), and 




denotes its adjoint operator. If Ai and A2 are matrices, then we define 

AieA2 = 




and if Xi and X2 are sets of matrices, then we set 

Xi(BX2 = { Ai e A2 \ Ai e Xi, A2 e X2 }. 

For instance, © {0} (where the order of the matrix will be clear from the context) 
stands for the set of matrices whose upper left r by r block is positive semidefinite, and 
the rest of the components are zero. 
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2 Characterizations of when P is well behaved 

For the characterizations on the well behaved nature of P, we assume that P is nonempty, 
and we need the following 

Definition 3. A maximum slack in P is a vector in 

Ti{z\z = h - Ax, z K} = ri ( {TZ{A) +b)nK). 

We will use the fact that ioi z € K the sets dir(z,i^), ldir{z,K), and tan(2:,i^) (as 
defined in (|1.5p ) depend only the smallest face of K that contains z, cf. Lemma [TJ 

Theorem 5. Let z be a maximum slack in P. Consider the statements 

(1) The system P is well-behaved. 

(2) The set 

A* o\ [k* 
b* ij \R+ 

is closed. 

(3) The set 




is closed. 

(4 ) n{A, b) n (cl dir(z, K) \ dir(z, K))=%. 

(5) There is u ^ M{{A, b)*) D K* strictly complementary to z, and 

n{A, b) n (tan(z, K) \ ldir(z, K)) = 0. 

Among them the following relations hold: 

© ^ © ^ © 

(HD ^ dSD 

In addition, let F be the smallest face of K that contains z. If the set K* -\-F^ is closed, 
then |ip through ^ are all equivalent. 

□ 

We first remark that if P is a homogeneous system, i.e., 6 = 0, then it is not difficult 
to see that P is well-behaved, if and only if A*K* is closed. So in this case Theorem [5] 
reduces to Theorem [3l 
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Second, we show an implication of Theorem [5l it unifies two classical, seemingly un- 
related sufficient conditions for P to be well behaved, and gives necessary and sufficient 
conditions in the case when K is nice: 

Corollary 4. The following hold: 

(1) If K is polyhedral, then P is well behaved. 

(2) If z £ hK, i.e., Slater's condition holds, then P is well behaved. 

(3) If K is nice, then conditions (0j through ^ are all equivalent to each other, and 
with the well behaved nature of P. 

Proof First, suppose that K is polyhedral. Then so is K* + F-^, which is hence closed. 
The set dir(2:, K) is also polyhedral, and hence closed. So the implication ([1]) =^ ([I]) 
in Theorem [5] shows that P is well behaved. Next, assume z € rii^. Then F, the 
minimal face that contains z is equal to K. So K* + F-^ equals K* , and is hence closed, 
and A\t{z,K) = YmK, which is also closed. Again, implication (H]) ([T]) in Theorem [5] 
proves that P is well behaved. (In these two cases we do not use the opposite implication 

If K is nice, then K* + F"*- is closed for all F faces of K, and this proves the last 
statement. □ 

In preparation to prove Theorem [5l we define the sets 

51 = 

52 = 

53 = 

We need a somewhat technical lemma, whose proof is given in the Appendix. 

Lemma 2. Let 82 € riS'2, and (s3;so) € riSa, where S3 G -fC, sq G M^. Recall that z 
is the maximum slack in P, and F is the smallest face of K that contains z. Then we 
have 

(1) S2 G riF. 

(2) S3GriF, so>0. 

(3) dir(z,K) = dir(s2,i^) = dir(s3,K). 

□ 



(7^(yl) + b)r\K, 
n{A, b) n K, 
'a b\ _ ( k 
1, 



■R 



n 



(2.12) 
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Proof of Theorem [5} We use the notation ^i, S2, and ^3 as introduced in (|2.12p . 
Also, in this proof, for a C closed convex cone, and x G C we will use the notation 

frdir(x,C7) = cldh(x, C7) \ dir(x, C7). (2.13) 

The proof is somewhat redundant (i.e. we prove more implications than strictly neces- 
sary), but this should improve its readability. 



Proof of ([3]) =^ ([T]) and ([2]) =^ ([T]) Let c be an objective vector, such that 
Co := val(Pc) is finite. Then aval(Z?c) = cq holds by Theorem HI i.e., there is {yi} C 
K* s.t. A*yi — )• c, and b*yi cq, in other words. 




(2.14) 



By the closedness of the set in ()2.14p . there exists y € K* such that A*y = c, and 
b*y = Cq. This argument shows the implication ([3]) ([T]). 

To prove © ^ ([U, note that 

By the closedness of the second set in (|2.15|) there exists y € K* , and s G such that 
A*y = c, and b*y + s = cq. We must have s = 0, since s > would contradict Theorem 
m Therefore y is a feasible solution to (Dc) with b*y = cq, and this completes the proof. 



Proof of ^ -i([T|) Now, let c and cq be arbitrary, and suppose they satisfy 



and 




Clearly, ()2.16p is equivalent to the existence of {(yi,Si)} ^ ^* ^ ^+ s-t. A*yi — )• 
c, and b*yi + Si ^ cq. Hence aval(Z'c) < cq. Also, Theorem S] implies val(Pc) = 
aval{Dc), so 

val(Pc) < Cq. 

However, (|2.17p implies that no feasible solution of (Dc) can have value < cq. Hence 
either val(-Dc) > cq (this includes the case val(-Dc) = +00, i.e., when (-Dc) is infeasible), 
or val(Z?c) is not attained. In other words, c is a "bad" objective function. 
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Proof of ([2]) ^ dH and of ([2]) <^ (g]) when K* + P-^ is closed: Let (53; sq) e ri ^3, 
and G the smallest face of K x M_,_ that contains (53; sq). Consider the statement 

frdir((s3;so),K x M+) n 7^ ^ = 0. (2.18) 

By Theorem [3] with 

M = \,C = Kx^,,E = G 

we have that ([2]) implies ()2.18p . and it is equivalent to it, when {K x M_,_)* + is 
closed. Obviously {K x R_^)* = K* x M.^.. Next we claim 

K* + G^ is closed ^ K* + is closed. (2.19) 

Indeed, by Lemma [2] we have (53; sq) € ri(F x so G = F x M^. Using the fact 

that F and M_|_ are cones, we obtain G^ = F^ x {0}, and this proves (j2.19p . (In fact, 
even if sq were 0, then G^ = F-^ x M would hold, and ()2.19p would still be true, since 
all cones contained in the real line are closed.) 

Next we claim 

frdir((s3;so),is: X M+) = frdh(s3, K) x R. (2.20) 
Indeed, by definition, the set on the left hand side of ()2.20p is the union of the two sets 

frdir(s3,Er) x cldir(so,K_,_) 

and 

cldir(s3,i^) X frdir(so,lR+)- 

But So > by Lemma [21 so dir(so,M^) = cldir(so,IR_|_) = M. So the second of these 
sets is empty, and the first is equal to the set on the right hand side of ()2.20p . 

Given (j2.20p . statement (|2.18p is equivalent to 

frdh(s3,is:) n n{A,h) =0. (2.21) 

By ([3]) in Lemma [2] we obtain frdir(z, i^) = frdir(s3, -ftT), so ()2.2ip is equivalent to Q, 
and this completes the proof. 

Proof of ([3]) ^ (SI) <^ dS]) and of ([3]) <^ (g]) ^ (p when K* + F^ is closed: 

Let S2 € riS'2, and consider the statements (I11-S2) and (I5l-S2) which are obtained 
from and ([5]) by replacing z with S2- By part ([1]) in Lemma [2] we have S2 G iiF. 
Therefore Theorem [3] with M = {A,b), C = K, E = F proves 

® ^ (jls2) ^ ©52), 

and that these statements are all equivalent, when K* + F^ is closed. By part ([3]) in 
LemmalU and the definition of the sets ldir(z,i^) and tan(2:,i^) in ()1.6p - (|1.7p we have 
that (jll-S2) is equivalent to dH and (I5]-S2) to ([5]), and this completes the proof. 

□ 
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3 Characterizations of badly, and well-behaved semidefi- 
nite systems 



We specialize the results on general conic systems in Theorem The pair of SDPs 
{SDPc) — (SDDc) fits into the general framework of Definition [1] by letting X = W^, 
y = 5", defining the operator A as 

m 

A.X — ^ ^ X'lA.'i 

i=l 

for X E M™, noting that 

A*Y = {Ai*Y,...,Am*Yf 

for Y € 5", and that the set of positive semidefinite matrices is self-dual under the • 
inner product. Also, a maximum slack as defined in Definition [3] is a slack matrix with 
maximum rank in the semidefinite system Psd, and the cone of positive semidefinite 
matrices is nice (see [31]). 

To obtain Theorems [T] and [2] we use transformations of the Ai and B matrices. We 
need to make sure that these keep the maximum slack Z in the original form stated in 
(jl.3p . For ease of reference, we define what transformations are suitable below: 

Definition 4. If T = © P, where P is an n — r by n — r invertible matrix, we call 
the transformation T'^QT a type 1 transformation. If T = Q ® In-r, with Q an r by r 
orthonormal matrix, we call the the transformation T'^QT a type 2 transformation. 

We collect some results on the geometry of the semidefinite cone in Lemma [3l The 
proof is given in the Appendix. 

Lemma 3. Let Z he a positive semidefinite matrix of the form hl.S^) . Recall the defini- 
tion of the set of feasible directions, and related sets from / [j.5|) - |777D . Then 

\dix{Z,Sl) 
cldir(Z,5^) 
tan(Z,5!^) 
dir(Z,5!^) 

Also, by using type 1 and type 2 transformations, all elements o/cldir(Z, 5")\dir(Z, 5") 



Yu 0' 

Vn Yi2^ 

Yu Y22J 

Vn Yi2^ 

(Yu Y12 

[Y,l Y22, 



Yu G 5^' ^ 



Y22 G s: 



Yn G I , 

\Y22€Si-'\n{Y,l)cn{Y22) 



(3.22) 
(3.23) 
(3.24) 
(3.25) 
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can be brought into the form 





(Vu 


ei 




V = 

















^33/ 



where Vu is r by r, e\ is the first unit vector, V33 is positive semidefinite (maybe an 
empty matrix), and the dots denote arbitrary components. 



□ 

Given Lemma El the proof of Theorem [T] is straightforward. 



Proof of Theorem [T] The equivalence ([T]) 44> dH) in Theorem [S] shows that Psd is 
badly behaved, iff there is a matrix V, which is a linear combination of the Ai and of 
B, and also satisfies 

V G cldir(Z,5!^) \dir(Z,5^). 

By the last statement in Lemma [3] we have that all such V matrices can be brought 
to the form (|3.26p with Vu € , and V33 positive semidefinite (possibly an empty 
matrix). We need to apply these transformations to all the Ai matrices, and to B as 
well. Since they are all type 1, or type 2, they keep the maximum rank slack Z in the 
original form (jl.3p . □ 



Proof of Corollary [1} Suppose that Psd is badly behaved. To find the minor system 
(jO.ip we first add multiples of the Ai matrices to B to make B equal to the maximum 
slack, i.e. 

i ■ 

0/ 



B = Z 



(3.27) 



By Theorem [T] there is a matrix V of the form 



Ml 



V = Y^ ViAi + voB 



V 



ei 






...\ 



V33/ 



(3.28) 



with V\\ being r by r, ei the first unit vector, V33 positive semidefinite (possibly an 
empty matrix), and the dots denoting arbitrary components. Since B is of the form 
described in ()3.27p . we may assume vq = 0, and we can also assume f 1 7^ without loss 
of generality. We then replace Ai by V, delete A2,. . . ,Am, and all rows and columns 
except the first, and (r + l)st to arrive at the system 



Xl 



Vu 




□ 
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Proof of Theorem [2} We use the equivalence ([I]) <J=> ([5]) in Theorem [5j Let F be the 

smahest face of that contains Z. Then clearly F = 5!^ {0}, and = {0 } 05^"^ 

Hence a U positive semidefinite matrix is strictly complementary to Z if and only if 

U = ^ I , with U22 y 0. 

So the first part of ([5]) in Theorem [5] translates into the existence of such a U which 
satisfies 

Ai»U = ... = A^»U = B»U = 0. 

Let P be a matrix of suitably scaled eigenvectors of U22 , and T = Ij. ® P. Replacing U 
by T'^UT, we may assume 

U = 

Since for a W symmetric matrix we have T~^WT~^ •T'^UT = W •U, we need to apply 
the inverse transformation T~^()T~^ to all Ai and B. Since = © P~^, this is 
also a type 1 transformation, which leaves the maximum rank slack Z unchanged. 

By ()3.22p and (|3.24p in Lemma [3] we have that the second part of condition ([5]) in 
Theorem [5] is equivalent to requiring that all V matrices, which are a linear combination 
of the Ai and and are of the form 





V = 

satisfy V12 = 0. □ 



Proof of Corollary [2] The certificates of the had behavior of Psd are the Z and V 
matrices in Theorem [TJ We can verify in polynomial time that Z is a maximum rank 
slack, using the algorithm of [11] or |30j . Since positive semidefiniteness of a matrix can 
be checked in polynomial time, we can also verify in polynomial time that a matrix V 
is of the form (|1.4|) . 

The well-behaved nature of Psd can be confirmed via Theorem (2) checking that a 
matrix U satisfies condition ([1]) is trivial. Verifying Condition ([2]) amounts to showing 
the equality of two linear subspaces, which can be done by standard linear algebraic 
techniques. □ 



4 A characterization of badly behaved second order conic 
systems 

In this section we study badly behaved second order conic systems, and derive charac- 
terizations similar to Theorem [1] and Corollary [TJ We first repeat the primal-dual pair 
of conic LPs here, for convenience: 
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sup c*x inf h*y 

s.t. Ax <K b s.t. y >K* {Dc 

A*y = c. 



The second order cone in m-space is defined as 



SO(m) = {x G M™ |xi > A/xf + ^^^+a^}. 

The cone SO(m) is also self-dual with respect to the usual inner product in M"*, and 
nice (see [31]). We call (Pc) — (Dc) a primal-dual pair of second order conic programs 
(SOCPs), if 

K = Ki X . . . X Kt, and Ki = SO(mi) {i = l,...,t), 
where rrii is a natural number for i = 1, . . . ,t. The primal second order conic system is 

Pso = {x\Ax<Kb}. 

Here we view the operator A as simply a matrix with n columns. We first review two 
pathological SOCP instances. Despite the difference in their pathology (one's dual is 
unattained, but there is no duality gap, in the other there is a finite, positive duality 
gap, and the dual attains), the underlying systems look quite similar. 

Example 4. Consider the SOCP 



(4.29) 



with K = SO(3). Its optimal value is obviously zero. The dual problem is 

inf yi + y2 

s.t. y3 = l (4.30) 
y>K 0. 

The optimal value of the dual is 0, but it is not attained: to see this, first let 

y, = + {i = l,2,...), 

then all yi are feasible to ()4.30p . and their objective values converge to zero. However, 
y = (yi, — yi, 1) is not in K, no matter how yi is chosen, so there is no feasible solution 
with value zero. 
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Example 5. In this more involved example, which is a modification of Example 2.2 
from we show that the problem 

sup X2 



s.t. Xl 




(4.31) 



where Ki = SO(3), and K2 = SO(2), and its dual have a finite, positive duality gap. 
The optimal value of (j4.3ip is clearly zero. 



(4.32) 



The dual is 

inf yi + 2/2 + wi 
s.t. yi + y2 + wi - W2 = 

ys +W2 = I 

y e Ki,w € K2 

Since y and w are in second order cones, yi > —y2 and wi > W2 must hold. Together 
with the first equation in (j4.32p this implies 

2/2 = -yi, (4.33) 
W2 = wi. (4.34) 

Using ()4.34p . and the second constraint in ()4.32p 

ys = I - W2 = I - wi, 

so we can rewrite problem (j4.32p in terms of yi and wi only. It becomes 

inf wi 

s.t. {yi,-yi,l - wif G Ki 
{wi,wif G K2, 

and this form displays that the optimal value is 1. 



Notice the similarity in the feasible sets of Examples H] and [SJ in particular, if we 
delete variable xi and the second set of constraints in the latter, we obtain the feasible 
set of Example HJ 

We will use tranformations of the second order cone to make our characterizations 
nicer. It is well known that if C is a second order cone, then for all xi and X2 in the 
interior of C there is a T symmetric matrix such that Txi = X2, and TC = C : such a 
rotation was used by Nesterov and Todd in developing their theory of self-scaled barriers 
for SOCP ([271 EHl)- One can easily see that a similar T exists, if xi and X2 are both 
nonzero, and on the boundary of C. So we are justified in making the following 
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Assumption 2. In Pso we can replace A and b by TA and Th, respectively, where T 
is a block-diagonal matrix with symmetric blocks Tj and TiKi = Ki for all i = 1, . . . , t. 
We also assume that the maximum slack in Pgo is of the form 



0;...;0; 



1 



1 



;ei; . . . ;ei 



\ \eiy \eij J 

(note that the dimension of the and e\ vectors can differ), and we let 

= {i£{l,...,t}\zi = 0}, 

R = {i G = (l;ei)}, 

1 = {i £ {I,. . . ,t}\zi = ei}. 



(4.35) 



(4.36) 



In the following we denote the blocks of a maximum slack z in Pso by zi, . . . ,zt, 
and write vi, . . . ,vt for the corresponding blocks of a vector v with the same dimension 
as z. We also denote the columns of A by Oj (i = 1, . . . , n). 



The main result on badly behaved second order conic systems follows. 

Theorem 6. The system Pso is badly behaved, iff there is a vector v = {vi; 
which is a linear combination of the columns of A and of b, and satisfies 

Vi G Ki for all i £ O, 
> Vi,2 for all i & R, 
/a\ 
a 
1 



for some j & R, 



where a is some real number, and the dots denote arbitrary components. 



(4.37) 



□ 

The z slack, and the v vector in Theorem [6] give a certificate of the bad behavior of 
Pso- They are 

Z = l \ , V = 

in Example m and 





in Example [5j 
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Corollary 5. Consider the following four elementary operations performed on Pso 





/a) 






Xl 


a 


1- 


1 











(1) Rotation: for some T invertible matrix satisfying TK = K, replace A by TA, 
and b by Tb. 

(2) Contraction: replace a column Oi of A with X]"=iAjaj, and replace b by b + 
X^j=i /"i^i) where the Xj and fij are scalars, and Aj ^ 0. 

(3) Delete rows other than a row corresponding to the first component of a second 
order cone from all matrices. 

(4) Delete a column ai. 

If Pso is badly behaved, then using these operations we can arrive at the system 



(4.38) 



where a is again some real number, and K is a second order cone. 

□ 

Corollary 6. The question 

"Is Pso well-behaved?" 
is in MV n co-MV in the real number model of computing. 

□ 

Proof of Theorem [G^ Since the second order cone, and a direct product of second 
order cones is nice, we can speciaUze Theorem [5l By the equivalence ([T]) (jj]) we have 
that Pso is badly behaved, iff there is a vector v, which is a hnear combination of the 
columns of A and of b, and also satisfies 

G cldir(z,E:) \dir(z,i^). (4.39) 

Clearly (|i39D holds, iff 



Vi € cldir(zj, ETj) for all i E {1, . . . , t} and 
Vj ^ d\v{zj, Kj) for some j G {1, . . . , t}. 



(4.40) 



The form of z implies 



dir(2;j,i^j) = Ki for all i & O, 
dir(zi,i^i) = M"^ for ah i G /, 
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so in particular dir(2;j, Ki) is closed when i € O U /. So (|4.40p is equivalent to 
Vi € Ki for all i £ O, 

Vi G cldir(2;j, Kj) for alH e i?, and (4-41) 
Vj € cldir (zj , Kj) \ dir {zj,Kj) for some j £ R. 

We now prove that if C is a second order cone, and w = (1; ei), then 

cldir(u;,C) = {v\vi>V2}, (4.42) 
cldir(u;,C) \dir(ti;,C) = {v \vi = V2, v^^., ^ 0} (4.43) 

holds, where v^^- denotes the subvector of v consisting of components 3,4,.... 

Let F be the minimal face of C that contains w, and its conjugate face. Then 
it is easy to see that 

F^ = cone{(l;-ei)}, 

and Lemma [T] implies 

cldir('w,C7) = (F^)*. 

Since F^ is generated by a single vector (1;— ei), its dual cone is the set of vectors 
having a nonnegative inner product with (1; — ei), i.e., ()4.42p follows. 

Next we prove (j4.43p . First note that (|4.42p implies 

ridir(u),C) = ricldir(it;, C) = {v\vi>V2} ^ dir(u),C). (4.44) 

Suppose that v is in the left hand side set in equation (j4.43p . From (j4.44p we get 
vi = V2, and v^^-, 7^ follows directly from v dir(ri;, C). Next suppose that v is in the 
set on the right hand side of equation (j4.43p . Then by ()4.42p we have v E cldir(ti;, C), 
and V ^ dir(w, C) follows directly from ^3^; 7^ 0. 

We then use (j4.42p and ()4.43p . exchange components in Vj to make sure that u^^s 
is nonzero, and do a further rescaling to make sure that it equals 1. Modulo these 
transformation (j4.4ip is equivalent to (j4.37p . □ 

The proof of Corollary [5] is analogous to the proof of Corollary [H and the proof of 
Corollary E] to the one of Corollary [21 so these are omitted. 

The duality theory of conic programs stated over p-cones is by now well-understood 
[2m [2] , and these optimization problems also find applications [15] ■ Hence it is of interest 
to characterize badly behaved p-conic systems, and this is the subject of the section's 
remainder. Letting p be a real number with 1 < p < +00, the p-norm of x € M'^ is 

ii^iip= (ixir+--- + ixfcnvp, 

and the p-cone in dimension m is defined as 

Kp^m = {x£W\xi > II (X2, . . . ,Xm) lip }• 
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The dual cone of Kp^m is -f^g.m, where q satisfies 1/p + 1/q = 1. 

It is straightforward to see that Kp^m does not contain a hne, and is full-dimensional, 
and w; G bd Kp^rn \ {0} iff 

w = (||x||p;x) 

for some nonzero x € M™^"*^. For such a t;; we define its conjugate vector as 

= (.\\x\\g;-x). 

Then G hd K^^m \ {0}, and {w,w^) = hold. 

Again recalling the conic programs (Pc) — (Dc), we call them a pair of primal-dual 
p-conic programs, if 

K = Ki X . . . X Kt, and Ki = Km„p, (i = 1, . . . , t), 

where is a natural number for i = 1, . . . , t, and 1 < Pi < +oo. The p-conic system is 

Pp = {x\ Ax <K b }. 

When all pi are 2, p-conic programs reduce to SOCPs. 

Theorem 7. Let z be a maximum slack in Pp, and define the index sets 

= {ie{l,...,t}\z, = 0}, 

R = {i£{l,...,t}\z,ehdKi\{0}}, 

1 = {i £ {1,. . . ,t}\zi eintK,}. 

The system Pp is badly behaved, iff there is a vector v = (vi; . . . ; vt) which is a linear 
combination of the columns of A and of b, and satisfies 

Vi G Ki for all i £ O, 
{vi, zf^) > for all i E R, 
{vj, z^) = and Vj linjzj} for some j E R. 

□ 

Theorem [7] reduces to Theorem[6l when all pi are 2, and its proof is a straightforward 
generalization. 

We finally remark that a characterization of well-behaved second-order and p-conic 
systems, analogous to Theorem [2] can be derived as well; also, the geometric and dual 
geometric cones of |19j have similar structure to p-cones, so Theorem[5]can be specialized 
to characterize badly and well-behaved systems over these cones. 
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5 Characterizing the well-behaved nature of conic systems 
in subspace, or dual form 



In this section we look at conic systems stated in a form different from P, and examine 
when they are well-behaved from the standpoint of duality. The short conclusion is that 
such a system is well-behaved, iff the system obtained by rewriting it in the "standard 
form" of P is. Most of the section's material is straightforward, so we only outline some 
of it. 

Wc first define a primal-dual pair of conic linear programs in subspace form, param- 
eterized by the primal objective yo as 

inf {yo,z) inf {zo,y) 

{P'yJ s.t. ze{zo + L)nK s.t. ye{yo + L^)nK* {D'J, 

and the primal conic system in subspace form as 

P' = (zo + L)nK. 

Feasible solutions, boundedness, and the values of (Pyg) and {D'yg) are defined in the 
obvious way. 

Definition 5. We say that the system P' is well-behaved, if for all yo objective functions 
for which the value of (Pyg) is finite, the problem (D'y^) has a feasible solution y that 
satisfies 

{zq , y) + val{Pyg ) = {zo,yo). 
We say that P' is badly behaved, if it is not well-behaved. 

Let us recall the primal-dual pair (Pc) — (-De) and the primal conic system P. 
Definition 6. If 

L = TZ{A) and zq = b, 
then we say that P and P' are equivalent. If in addition 

A*yo = c, (5.45) 
then we say that (Pc) and (Pyg), and (Dc) and {D'yg) are equivalent. 

Clearly, for every conic system in the form of P there is an equivalent system in the 
form of P' , and vice versa. Also, if A is injective, which can be assumed without loss 
of generality, then for every conic LP in the form {Pc) there is an equivalent conic LP 
in the form of {Pyg), and vice versa. 

The following lemma is standard; we state, and prove it for the sake of completeness. 
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Lemma 4. Suppose that {Pc) is equivalent with {P'yg), and (Dc) with (D'y^^). If x is 
feasible to (Pc) with slack z, then z is feasible to (Pyg), and 

{c,x) + {yo,z) = {yo,zo). (5.46) 

Also, 

val(Pe)+val(P;j = {yo,zo). (5.47) 

Proof The first statement is obvious, and ()5.46p follows from the chain of equalities 

{yo,zo) = {yo,Ax + z) 

= {yo,y^x) + {yo,z) 
= {A*yo,x) + {yo,z) 
= {c,x) + {yo,z). 

Suppose that x is feasible for (Pc) with slack z. Then z is feasible for (Pyg), and 
(|5.46p holds, therefore 

(c,x)+val(P;j < {yo,zo), (5.48) 
and since (j5.48p is true for any x feasible solution to (Pc), the inequality < follows in 

In reverse, let z be feasible to {Py„)- Then there is x that satisfies z = zq — Ax, so 
this x with the slack z is feasible to (Pc), so ()5.46p holds, therefore 

va\{P,) + {yo,z) > {yo,zo)- (5.49) 

Since ()5.49p holds for any z feasible to (Pyy), the inequality > follows in ()5.47p . □ 

Combining Lemma H] with Theorem [S] we can now characterize the well-behaved 
nature of P' . 

Theorem 8. Let z G riP'. Consider the statements 

(!') The system P' is well-behaved. 
(2') The set 

(-;)'■•(:;) 

is closed. 
(3') The set 

(L + zo)^ + K* 

is closed. 
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(4 ') lm(L + zo) n (cl dir(z, K) \ dir(z, if)) = 0. 

(5') There is u G {L + zq)-^ strictly complementary to z, and 



lin(L + Zo) n (tan(z, K) \ ldir(z, K)) = 0. 



Among them the following relations hold: 



{!') ^ (2' 



) <= (30 



(4') ^ (50 



/n addition, let F be the smallest face of K that contains z. If the set K* + F is closed, 
then (1') through (5') are all equivalent. 

Proof Define the conic system P to be equivalent with P' . Then z is a maximum slack 
in P, and it suffices to show that statements (1), ... (5) in Theorem [5] are equivalent to 
(1'), . . . (5') respectively. 

Proof of (1) ^ (10 Consider (P^^J with some objective function 2/0) and let c = ^*yo- 
Then {Pc) and (Py„) are equivalent, so ()5.47p in Lemma H] implies that val(Pc) is finite, 
if and only if val(P^^J is. 

Also, {Dc) and (Dyy) are equivalent with the same feasible set, and the same ob- 
jective value of a feasible solution. Combining this fact with (j5.47p . we see that there 
is a 7/ feasible to {Dc) with b*y = val(Pc)! iff there is y is feasible to (-D^^J with 
{zq, y) + val(Py^) = (yo) -^o)) and this completes the proof. 

Proof of (2) ^ (20 Since TZ{A) = L, we have N{A*) = L^. By a Theorem of Abrams 
(see e.g. [B] ) if C is an arbitrary set, and M an arbitrary linear map, then MC is closed, 
if and only if J\f{M) + C is. 

Applying this result we obtain 




It is elementary to show that 




and this completes the proof. 



The remaining equivalences follow from 



n{A,b) = lin(L + zo); 



(5.50) 
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to prove (3) <^4> (3') we also need to use Abram's theorem again. 



□ 



In the rest of the section we discuss how to define the weh-behaved nature of a conic 
system in dual form, and relate it to the well-behaved nature of the system obtained by 
rewriting it in subspace, or in primal form. 

Definition 7. We say that the system 

D = {y £ K*\A*y = c} 

is well-behaved, if for all b for which v := mi {b*y \ y £ D} is finite, there is an x 
feasible solution to (Pc) with c*x = v. 

We can rewrite D in subspace form as 

D' = {yo + L^)nK*, 

where L-^ = J\f{A*), and A*yQ = c, and also in primal form as 

D" = {u\Bu <K* yo}, 

where B is an operator with 7Z{B) = J\f{A*). Actually, we have D = D', but the well- 
behaved nature of D and D' are defined differently. Also note that y G D iff y = yo ~ Bu 
for some u E D" . 

Theorem 9. The systems D, D' and D" are all well- or badly behaved at the same 
time. 

Proof Obviously, if b = zq, then val(i?^^J = mf{b*y\y £ D}. By definition D' is 
well-behaved, if for all zq for which val{D'y^^) is finite, there is a z feasible solution to 

{Py„) With 

(z,yo) + va^D^J = {yo,zo). 

Using the first statement in Lemma H] with ()5.46p it follows that this holds exactly when 
there is an x feasible solution to (Pc) with c*x = inf{6*y|y G D}. This argument 
proves that D is well-behaved if and only if D' is. 

The argument used in the proof of the equivalence (1) 44> (1') in Theorem [5] shows 
that D' is well-behaved, if and only if D" is, and this completes the proof. 

□ 

We can state characterizations of badly behaved semidefinite or second order conic 
systems given in a subspace, or dual form in terms of the original data. We give an 
example which is stated "modulo rotations", i.e. making Assumption [TJ We omit the 
proof, since it is straightforward from Theorems [1] and [9j 
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Theorem 10. Suppose that in the system 

Y to, Ai»Y = bi{i = l, 
the maximum rank feasible matrix is of the form 



(5.51) 



Y 



7, 0^ 
0, 



Then i5. 51\) is badly behaved if and only if there is a matrix V and a real number A with 

Ai»V = Xbi (i = 1, . . . ,m), 

and 



(v. 



V 



11 ei 



...\ 




V : ^33/ 

where Vn is r by r, ei is the first unit vector, V33 is positive semidefinite (may be an 



empty matrix), and the dots denote arbitrary components. 



□ 



A Appendix 



Proof of Lemma [2} We first prove 

riSi nriSs / 0. 
Let si G ri^i, S2 G i'i'S'2> and let us write 



si 

S2 



Axi + b, 
Ax2 + by2 



(A.52) 



(A.53) 
(A.54) 



for some xi, X2 and y2- Since si G 52, by [331 Theorem 6.1] the hne-segment (si,S2] is 
contained in 06*2, in particular, for some small e > we have 

si(e) := (l-e)si + es2 

= A[{1 - e)xi + 6X2] + 6[(1 - e) + ey2] G ri ^2. 



Define 



1 



-si[e . 



(A.55) 



1 - e + ey2 

If e is sufficiently small, then the denominator in ()A.55P is positive, so s'^(e) G Si. Also, 
52 is a cone, and si(e) is in ri52, hence so is s[{e). Hence we have 



s'i(e) G 5i nri52. 



(A.56) 
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Also, since s'i{e) si, as e — > 0, and si € riSi, by (|A.56p we obtain 

s'i{e) G riS'i n riS2, 
for small enough e > 0, and this completes the proof of (|A.52p . 

We note that since ri5i is relatively open, and convex, by [33l Theorem 18.2] it is 
contained in the relative interior of a face of K. Since riS'i and liF intersect (in z), this 
face is F, so ri5i C riF. Similarly, ri52 is contained in the relative interior of a face 
of K; by (|A.52p and ri Si C ri F, we have ri 5*2 C ri F. This finishes the proof of ([T|) in 
Lemma [2j 

In ([2]) we first prove sq > 0. Since (s^; sq) £ S3, there exists X3 satisfying 

S3 = Axs + bsQ. (A.57) 

Let si £ Si. Expressing si as in ()A.53p shows (si; 1) € 6*3. Hence by [331 Theorem 6.4] 
the line-segment from {si; 1) to (53; sq) can be extended past (53; sq) in 53, i.e., for some 
small e > we have 

(l + e)(s3;so)-e(si;l) G ^3, (A.58) 

hence sq > 0. 

Define S3 := S3/S0. Since 53 is a cone, and (53; sq) is in ri53, so is (sg; 1). So (jA.SSp 
holds with (S3; 1) in place of (S3; sq), i.e., there is a small e > such that 

(l + e)(s'3;l)-e(si;l) = {{I + e)s'^ - esi;l) £ S^. (A.59) 

Dividing in (|A.57p by sq we see that S3 G Si. Also, (|A.59p implies 

(l + e)s;5-esi G Si, 

hence S3 G ri Si . Since ri Si C ri F, we obtain S3 G ri F, hence S3 G ri F, and this finishes 
the proof of i^. 

Statement ^ then follows from using Lemma [1] with the fact that the minimal face 
of K that contains z,S2, and S3 is the same, namely F. □ 

Proof of Lemma [3l Let F be the smallest face of 5" that contains Z. Then clearly 
F = SI® {0}, and = {0} Si'''. Hence (F^)* is the set on the right hand 
side in equation (j3.23p . and Lemma [1] with C = 5", x = Z, E = F proves statements 

Next, fix y G cldir(Z, 5"), and partition it as in the right hand side set in (|3.23p . 
Proving ()3.25p is equivalent to verifying 

Y G dir(Z,5^) ^ niY^2) ^ ^(^^22). (A.60) 

Let P be an orthogonal matrix whose columns are suitably scaled eigenvectors of I22, 
with the eigenvectors corresponding to zero eigenvalues coming first, and T = I^- ® P. 
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Clearly 

TTyt =( 

We claim that both sides of the claimed equivalence (|A.60p are unchanged, if we replace 

Y by r'^yr, i.e., 

Yed\v{Z,Sl) ^ T^yr G dir(Z, 5^), (A.61) 
^(1^2) ^ ^(>^22) ^ n{P^Yl^)<Zn{P^Y22P) (A.62) 

hold. Indeed, (|A.6ip follows from ZT = Z, and the definition of feasible directions. 
As to (jA.62p . the left hand side statement is equivalent to the existence of a matrix D 
such that 

= Y22D, (A.63) 
and the right hand side statement to the existence of a matrix D' such that 

p'^Y^2 = P'^Y22PD'. (A.64) 

Now, if ()A.63p is satisfied by some D, then (|A.64p holds for D' = P^^D. In reverse, if 
(TOip holds for D', then D = PD' verifies ^Amh . 

Let s > be the number of nonzero eigenvalues of 122, and define V = T^'^YT. Then 

V is of the form 

fVn V12 Vn\ 

(A.65) 





(Vn 


V12 


^13\ 


V = 







"J 











)=Yi2 


P. 







where Vu = Yn, and {Vu, V13 

Clearly, TZiP^Y^^) ^ 'R{P'^Y22P) is equivalent to V12 = 0. Hence, using statements 
(|A.6ip and (|A.62p the claimed equivalence (|A.60p is equivalent to 

V G dir(Z,5^) ^ V12 = 0. (A.66) 

Consider the matrix Z + eV for some e > 0. If V12 7^ 0, then Z + eV is not positive 
semidefinite for any e > 0, and this proves the direction in ()A.66p . As to <;=, if 
V12 = 0, then by the Schur-complement condition for positive semidefiniteness we have 
that Z + eF ^ iff 

{U + eVii) - (eFi3)(e/s)~'(eVi^) >= 0, 

and the latter is clearly true for some small e > 0. This argument finishes the proof of 
fOH]) . and hence of (13:25]) . 

We now prove the last statement of Lemma [3l The previous argument shows that 
all elements in cldir(Z, 5") \ dir(Z, 5") can be brought to the form of (|A.65p with 
Vu G s > 0, and V12 7^ using a type 1 transformation. 

Suppose that V is in this form. By exchanging rows and columns, we can make 
sure that the first column of V12 and the first row of are nonzero, and by rescaling 
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that they have norm 1. These changes in V can clearly be done by suitable type 1 
transformations. Next, let Q be an orthonormal matrix that maps the first column of 
Vi2 to ei, and T = Q ® In-r- Replacing V by T^VT makes sure that it is in the form 
(j3.'26p with Vii € iS**, and V33 positive semidefinite (possibly an empty matrix). □ 
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